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Proposal For 

Continuation of MICRO-AUTOMATION Development 

This proposal discusses practical aspects of our project to produce a 
repl I cab la research tool for development of real -world compute r- 
controlled hand-eye systems. If this proposal Is read out of context. 
It will not seen very sophisticated because It is concerned mainly with 
the practical aspects of putting together an engineering system. The 
theoretical and conceptual context is described more thoroughly in the 
nemo, supplementary to our main ARPA contract proposal, that describes 
in detail robotics research at the MIT A.I, Laboratory. 

Host of the points herein explain ways in which the original proposed 
program is progressing, or has been modified. There are two main 
changes in the plan. First, we are proceeding toward the "micro" domain 
In a somewhat different route than originally planned, because of the 
intermediate development of a high-quality mechanical manipulator that 
takes us halfway with no difficulty; this will allow more time for 
innovat ion at the next stage, still meets our condi t Ions for desk- top 
operations, and involves Identical software and systems. Second, we now 
Intend to proceed more rapidly than originally planned toward a 
particular practical application domain, or "world 11 , because of a 
similar decision withfn the project's main robotics group. The 
appl Icatlon area, electronic assembly, presents a reasonable level of 
challenge to the developing systems, should certainly have some valuable 
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outside applications, and deals with a variety of shapes and structures 
that are encountered In many other environments. 
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1.1 What's !leen Hone 

A study has been made of manipulator geometries and trade-of f s. A 
simple arm has already been designed and built by David Silver as a 
test^bed for some of the Ideas, Its degrees of freedom are split 
between motions In the arm and notion of the work table/ simplifying 
many mechanical elements (see 3.5), It Incorporates the force-sensing 
wrist developed by MInsky and Shah earlier In the project. Experience 
with this arm has contributed to our ideas of how arms should be 
controlled when direct/ sensitive force feedback Is available. It was 
gratifying to find that the programs for a number of diverse goals 
turned out to be fairly similar. For example/ the feedback techniques 
for turning a crank need little change for putting a nut on a bolt. 
There is more to learn, practically and theoretically/ about force- 
controlled manipulation of constrained systems by compliant hands. 

MECHANICAL ARM: A new arm has been designed by Victor Schelnman and Is 
In the process of being built. This arm Is moderately small in scale, 
and should be precise enough and easy to control, tie plan to use It for 
the next year or so. It is of the serial degree of freedom type. We 
expect to develop theories of good design for arms bul 1 t on smal ler 
scales during this period; these will almost surely use less orthodox 
arrangements of the degrees of freedom (see 3.5). The Schelnman arm, 
being built now, fits the size range for our next manipulator problem 
doma in/ that of electronic assenbl y. Inspect ion and repai r. 
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FORCE AND TACTILE SENSORS: We have studied a variety of force feedback 
schemes. The 50 called "force-ref lecti nz" or "bilateral servos" that 
&fe popular In human-operated remote manipulators have only limited 
application In controlling arm notion and preventing overloads. These 
devices depend on measurement of loads on the driving motors, and 
delicate halances are required for approximate cancellations of Innrtlal 
and gravitational terms. It should be much more efficient to measure 
real forces close to the hand and for guiding its Interactions with the 
objects It holds or touches. For fast, delicate operations, we think 
that high-compliance hut hrakeable members will be desirable. Also 
useful, will be touch sensors on the fingers themselves for the most 
rapid and sensitive measurements. 

Oifferent servoing techniques apply to these different kinds of 
information. It would be best to perform all the servo calculations in 
the computer since analog circuits would not be able to incorporate the 
non-linear Interactions between the links of the (model) arm and the 
force sensors, at least not without a very complex development program. 
The most plausible servo strategies seem to require combinations of 
force and position control analogous to combinations of current and 
potential sources. 

■ 
Exper inental studies, up to now, have been done using our POP-6 as the 

"mini-computer" with our Interim arm and force sensing wrist. 
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Coninun I cation with the time-sharing computer was via shared core and did 
not model accurately the character-level link we will have to deal with 
later. 

COMPUTER SELECTION: A detailed study was made to determine which mini- 
computer would be best for interfacing to the manipulator, the vision 
and force sensors, and to the remote larger computer. Size and ease of 
program development were taken into account. It was found important 
that the mini-computer be able to handle the details of the mechanical 
servomechanisms (see below) as well as a great deal of picture 
processing* Only If these are done locally can we achieve the goal of 
having the "high level" planning done In real time by a remote larger 
computer system, via the network. No special hardware need be developed 
for the network control, A pnp/ll-i*0 was chosen and ordered. 

1.2 What We are Doing Flow 

■ 

MECHANICAL ARM: At this time the new arm is being built. Several 
copies will be constructed, aside from ours; Stanford will be getting 
two and the University of Illinois Is planning to get one. Other 
institutions have expressed interest, which Is satisfying since it is In 
line with the intent of the mini-robot proposal that other researchers 
should use compatible modules. The new arm was designed by V. Schelnman 
while on -loan to MIT from Stanford, 
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D* Silver's Arm, which is Available now, will soon he controllable from 
our time-sharing computer by evaluating expressions In the LISP 
language* Since It is less dangerous, more accurate, and easier to use 
than our old equipment. It will invite experimentation by people 
interested In such topics as language understand! ng. Thus, we shall 
soon have a prototype of the facility that will become available later 
when our mini -computer will be interfaced to the new mini-arm and the 
time-sharing computer* We certainly can expect an attempt to interface 
It to Wlnograd's language-understanding system. 

EYES: While building the linear-array and mirror system, we will 
continue to study other sensors and obtain information from groups 
successful In specialised applications/ such as the M.I.T. Space 
Research Center* We are also In contact with RInford, at Stanford, who 
is completing a sensor study. There is a problem in determining which 
trade-offs and problems are inherent In the devices and which are due to 
poor design and manufacture. 

CONTROL: As the hardware is assembled It will become easy to attract 
students to the problems of servo control, manipulation languages, and 
representations of physical models* Work on the latter is under way in 
several of the projects discussed In the A.I. Main Proposal, and will 
not be repeated here. We are keeping an eye on a possibly similar 
effort in Professor Dertouzos 1 group at HIT, 
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1.3 Uhat Ue Plan to Do: 

SYSTEM: The first task will be to Integrate the various pieces of 
hardware* The mechanical hardware will first be assembled In a modular 
system to allow easy change and expansion. We do not have enough 
practical experience to decide which motions of the eyes, for example, 
are Indi soensible; is the apparent convenience of an eye mounted on one 
of the hands worth the extra complexity it would add to the vision 
programs? Probably, yes. Early experience with the application domain 
should then supply a basis for choosing between generality and special 
features of the minirobot conf igurat ion. 

Next/ the programming system must be put together. it will need an 
executive to stand between the character-level network link and the 
minirobot system primitives. Commands like "pick up that resistor" must 
be translated from high-level description in the large computer into a 
language of feature^locat ion, tracking, and motor commands. Most such 
actions have to be goal -directed and transl a ted Into i n te r r up t-d riven 
sub^procedures in the minirobot, and this is probably best done by 
demons or production-like conditionals. The programming system at the 
minirobot end has to work In terms of geometry, coordinate 
transformations of visual features, motor torques, and such quantities. 
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while the high-level system talks about objects, paths In space, 
relations between objects. 

Because of United data rates, it is not practical to transmit pictures 
to the main computer. That machine must send requests to control the 
picture processing facility In the mlnlrohot to derive and return 
intermediate level descriptive data. There are similar. If milder, 
limits on remote control of mechanical activities; we must transmit, 
instead, descriptions of control strategies. This is a new kind of 
control problem/ we think, hut not Inherently too difficult. Experience 
with real applications will suggest useful primitives for both 
manipulation and vision, 

APPLICATION: We plan to develop and test the complete system in an 
environment of assembly. Inspection and repair of discrete electronic 
circuits. This should prove out the hardware as well as the 
progranmlng concepts. We have to develop ways to marry the senses of 
sight and touch In order to control such activities as component 
insertion, soldering and unsoldering, wiring, etc. Some tasks are well 
suited to using either visual or tactile feedback, many require both. 
Little work has been done on such problems. 

MICROMANIPULATION: We are deeply interested in the problems of micro- 
manipulation. There are serious engineering problems in scaling down tc 
very snail sizes, the conventional serial arrangement of links with 
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motorized joints. Thorn is no fundamental problen of principle here, 
for one sees solutions in insects and crustaceans. But there are also 
alternative designs that appear to he nuch easier, using tendon- 
controlled "parallel" arrangements (see 3.5). Ue have not yet 
thoroughly studied the engineering problems of such conf igurat ions: 
nl cro-manipulators hnve new problems and design choices. We have 
studied several designs of tendon control led, para 1 lei der^ree-of -freedom 
manipulators, but have not looked at the down-to-earth details of how to 
build one to compete In accuracy, versatility and solvability with Its 
larger, wel 1 -understood brothers* 



The Electronics Application 



2. 1 I ntroduct Ion 



Our original proposal described at length what we feel are urgent 
problems that require the development of a generally available set of 
laboratory tools for research In machine vision, manipulation, and 
advanced production technology. We want to fully develop a laboratory 
system that is Inexpensive enough for widespread use yet powerful enough 
to perml t serious research* 
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Our primary objectives durinn the coming ynar are to develop vision, 
manipulation, and debugging languages and equipment, toward the 
development of an application demonstration to test out the laboratory's 
modules and stimulate Interest In using the laboratory elsewhere. 



2. 2 The Electronics Problem 

Concurrent with the development of general software tools, we want to 
work out a specific application using the evolving system* This Is 
important for two reasons: first, only a successful piece of 
application research can demonstrate the mini-robot's competence 
(utility?) as a laboratory tool; second, the development of general 
hardware and software of this kind is more likely to be relevant to rea 
problems if a real problem is attacked in the course of the research. 

In our original proposal we cited a need for advanced, visually 
conscious machines in such areas as manufacturing, mi ning, hous ins, 
transportation, space, farming, and medicine. Of these we feel that 
manufacturing Is the best area for our initial effort since the visual 
world encountered In typical manufacturing si tuat ions Is relat 1 vel y 
simple and constrained. 
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In particular, we believe that the assembly/ inspection, testing, and 
repair of electronic circuit boards offers a rich variety of problems In 
a form that allows rapid progress and eventual generalization. 

We next discuss this application In detail. One might wonder whether 
this Is a realistic area for practical application, Electronics assembly 
Is already one of the most automated of industries; and for mass- 
production problems It is hard to compete with special -purpose assembly 
machines. However, we are not concerned so much with the value of any 
one application, but with stimulating growth In this area, and It should 
be remembered that fabrication and assembly are not all of production; 
testing/ repair, installation, and Inspection are important problems. 



2,3 Scenario 

As a first step, we propose to work toward a system that looks at a 
scattered set of resistors, diodes, and Integrated circuits on a table, 
selects the proper ones, bends the leads If necessary, and Inserts the 
components In the proper holes. White doing this, verification and 
testing of the part would he a relatively simple matter. 
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We believe that such capability would be much root* useful than one night 
at first think. We have found that in the mini-computer industry much 
of component insert Ion Is still done by hand rather than hy special 
purpose machine. This is probably typical of manufacturing In r.ennral. 
Except for vf^ry long production runs. It Is too expensive to design 
special-purpose assembly machines, and present-day "general-purpose" 
machines are simply not general enough, or economical enough. As our 
technology advances, inexpensive minicomputer systems will acquire 
sophisticated visual and tactile senses and the modest intelligence 
needed to be useful In many such manufacturing points. 

In any case, the assembly project we propose is a way of Initiating work 
on visual and tactile skills with very wide potential application in 
other areas. The very fact that the Immediate application, electronics, 
is already substantially automated might be considered to favor the 
project's chances of maintaining neutrality In economic arguments. 

Within the electronics industry Itself, the assembly skills of part 
recognl t Ion, orientation, and attachment are prerequisl tes to an 
automated repair facility. We imagine a demonstration In which a user 
requests the replacement of a bad diode or perhaps even an integrated 
circuit PIP. The mini-robot, acting as a repair specialist, would then: 

1. visually locate the speci fled part 

2, clip off Its connecting leads 
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3. desolder the clipped-free leads from the board us I no a force 
sensitive tug to pull then out 

l*. visually inspect the holes to be sure they are free of solder 

5* insert the new part guiding it to the correct position with a 
combination of visual and tactile feedback 

6. solder in the new part 

7. inspect the newly solder joints and resolder if necessary. 

The problem of visually locating a troublesome part Is another form of 
the general problem of finding parts In a box or bin. The problem of 
Inserting a replacement part Is a low precision / high tolerance special 
case of the general parts orienting and assembly problem. 



Next we would work toward circuit debugging aids to give the test 
programs the same capabilities that technicians now have. The mini- 
robot should have the ability to: 

1. visually locate a part and connect a probe to one of Its leads 

*\ disconnect a part from the board for testing in isolation 

This might be done by removal or by sawing narrow gaps in PC 
board wires, to be re-bridged after the test. 
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2.*i \Jhy We Can no I t 

Electronics assembly and repair is particularly attractive to us because 
a substantial part of our hardware and software experience from earlier 
work on the blocks world Is carried over: 

1) Our present programs for locating blocks In space depend on 
relations to the surfaces on which they rest. Although use of 
range-f I ndlng will chance this, the general slnpliclty of planar 
circuit assemblies will simplify the transition, 

2) The parallel faces of blocks permitted our successful use of 
industry's primitive, simple, parallel jaw hands. The tubular or 
rectangular shapes of most electronic components require only small 
augment at Ions or Indentations in the hands. Man I pu I at ins w! ring Is 
a new subject, but one that would seen to be more a matter of 
software than mechanics. 

3) Searching for Insertion holes at the ends of printed circuit 
wires should require only slight modification of existing line 
tracking and vertex^f 1 nd lng programs. 

k) Turning cranks and screwing on nuts has been done in our 
Laboratory, using force-feedback operation. The problems of 
jiggling parts Into place and inserting them ought to succumb to 
slmi lar methods* 

l/e have some experience with analysing curved surfaces. Intensity 

distributions and highlights (Ph.D. Theses of Horn and Krakauer) — which 

should help in examining soldered joints for flaws, etc. But this area 

is still very poorly developed and we would hope that success of the 

project as a whole, in getting robotics equipment into other research 

centers, will lead to more rapid progress on sub-topics like this. 
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2.5 Why I t's Important 

The practical benefit of devices that could descend from such n 
prototype will be enormous. For example* in the mini -computer 
manufacturing business such inspection, testing and repair operations 
can account for as much as half the cost of getting raw components 
together Into a functioning, debugged device. Repair Is today an 
unavoidable manufacturing opera t ion. 

fin another order of sophistication, a command like "replace that 200K 
resistor" would generalize to things like "remove that engine, grind the 
valves, and put it back" or "repair that leaking pipe" or "replace all 
the burned-out light bulbs in this factory" or "chip off all the bad 
paint on this ship and repaint it". 



3. NOTES 



5.1 Mini -Robot Programming Concept 

The Mini-Robot computer can be used In a variety of modes. Mini- 
Computers are oulte powerful and can provide many of the features (such 
as file-handling on a cassette tape or cartridge disk) available on a 
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time-sharing system. The Importance of such features, as well as the 
value of local editing, assembling, and debugging, depend on the 
bandwidth of the associated network and on the costs of remote 
computation; we are Inclined to begin with a relatively high level of 
local autonomy. 

When used as a slave from a distant computer over a character-level 
interface (such as a teletype or the network), the minicomputer 
supervisor will run a conmand interpreter and a set of primitive 
subroutines which define Its behavior. There can be several sets of 
these primitive subroutines depending on the users' interests. These 
routines will handle the A/D and D/A (for servoing, force sensing, 
etc.), switch contact inputs and relay contact outputs (touch sensors, 
brakes), the eye and ranging devices, as well as the real-time clock. 

The character strings will be in the form of lists. Both the commands 
to the Mini-Robot and the values returned will be in this form. Usually 
the values will be returned when the requested action has been taken, 
but many commands will create or delete demons that run programs without 
network Interaction. There will be Interrupt features for both 
dl rect Ions* 

The communication protocol may be highly compressed for encoding blocks 
of data and transmitted program code. 
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The heternrchlcal programming style will require dynamic allocation and 
dynamic creation of primitives. This will need a stronp, function 
definition facility v<j! th some sort of local compiler. 
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5.2 Manipulation Languages: 

This Is still a new field. A good manipulation language (system) needs 
access to a good description of the specific manipulator and Its 
properties. That model Is needed not only in straightforward geometric 
matters like determining hand position from joint position, hut In 
choslng motion strategies compatible with the dynamics of the motions, 
the constraints on forces, etc. A manipulator with servo control 
separately for each joint cannot move fast In constrained trajectories 
or In a fashion Independent of the loading on the various joints. 
Computer servo control, on the other hand, can allow for the 
interactions of inertias and joint angles. The arm language, therefore, 
must allow easy specification of servo strategy. Somewhat more 
complicated is the Incorporation of three levels of force and touch 
sensing. The language must allow goal oriented task specification as 
well as taking care of unexpected events. Some extension to the Ideas 
embodied In Ernst's program are needed to handle more complex force and 
touch sensing. We expect some of the simple force and position control 
programs we have used on our simpler arm to turn out to be fairly 
general, many tasks requiring only simple additive combinations of force 
and position control. 
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3.5 Considerations In the Design of a Manipulator 

Many trade-offs wore incorporated in designing Schelnman's new mini-arm. 
The result is hoped to he robotic's most useable research arm to date. 

Maximum load will be about 3 lhs. 

Speed will be sufficient to allow almost all motions to be 
completed in less than one second 

Workspace will have a radius of about 15" 

Accuracy will be about .01". 
Easy solution methods are available because the last three rotory joints 
have intersect ing axes. 

Stiffness Is largely a matter of motor torques, portability is assured 
because the complete arm will weigh only 10 - 20 lbs. Highly reliable 
1>,C, torque motors ^re used. The arm will be versatile because of its 
high "aspect ratio" — volume of work-space conpared to volume occupied by 
manipulator as seen from the hand. The cost will be about $3,000 to 
produce in small quantities, and the arm "looks right 11 ! A lot of 
thought went Into the decision to make all joints rotary. A number of 
other factors such as sensitivity to environmental factors were 
considered when the materials were chosen. 
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3.J* Choosing a Hi nicomputer: 

flore than **$ companies offer minicomputers available locally. Most have 
16 bit word-length and address up to 32k words. Many are copies of DEC 
machines or DfiC Novas, Some have immediately obvious problems such as 
f i xed page posl t Ion rather than addressing relative to PC, Other 
deficiencies are the poor register structure of the Varinn machines and 
the primitive I/O structure of Texas Instrument machines. Some 
companies may or may not continue to pxist very long, others have no 
software. The ones looked at in some detail include: 

DRC Nova 1200, Nova 300, DEC POPll/^O, POPH/4 5 
Lockheed Electronics SUE, Honeywell 716, 
Interdata 20, Texas Instrument 96 OA and 9R0A, 
Varlan 62ni and 23, HIcrodata lfioo, and H.P. 2115A. 

Considerations Included ease of generating software, ease of Interfacing 
to specialised equipment, availability of peripherals, speed and cost, 
reputablllty of manufacturer, hardware architecture, instruction sets, 
availability of optional features like D.fUA,, Multiply/Divide, 
addressing nodes and ease of handing Interrupts, physical size, and 
del I very time. 



PARE 21 



The choice finally narrowed down to the tJova 800 and the PDPH/fcO. The 
latter was chosen for reasons of compatibility with machines In and 
around the project and to avoid having to duplicate prosranmlnj; and 
hardware Interfacing efforts. 
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PHASE A 
TIME SCALE end of '2 

Illlll COMPUTER POP 6 
MANIPULATOR Silver arm 



FORCE SENS I HG Shah wrist 
LVDT's 



PHASE P. 
end of '3 
PDPH/UO 
Schelnnan arm 



PHASE C 

after that 

sane 

Tendon controlled 
micro-manipulator 



One-piece wrist sane 
SC strain places 



Sche«nnan hand 
riicro-swf tches 



HAND/FINGERS Silver hand 

TACTILE SENSE 

VISUAL SENSOR Image dissector Photo-diode 

RANGE F HIDING 



Mul ti-f i nr-er pr 1 pper 
Fihre optic 

V I d I con/ I mace dissector 
Projected si it 



COMMUNICATION Core link 



Fast ASCII link Aft PA network 
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5.5* SERIAL VERSUS PARALLEL DECREES OF FREEDOM 

A manipulator needs many decrees of freedom. To understand the 
resulting complications, we need some sort of general framework for 
analysis, but we don't even have a useful taxonomy for classifying the 
problems. Here we will contrast two extreme kinds of anatomical 
approaches; quite a few issues emerge clearly even from this primitive 
dichotomy. The two extremes are "serial" and "parallel". 

In a SERIAL arm, we have a sequence of bodies, usually rigid 

rods, whose positions are determined by a series of 

constraints — joints — in which each constraint fixes the 

position of a body that serves as the support for .ill its 
successors. Thus the degrees of freedom have a distinct 
order. 

All the industrial manipulators are of this character. The human arm 1' 
representative of the serial variety, in general plan, although It Is 
really an Intermediate case because each joint may combine two or even 
three degrees of freedom. The human wrist, from the outside, appears to 
have three degrees, but the rotation Is really associated with the 
radlus-*ulnar relation which should he considered a separate joint. 

The PARALLEL concept Is perhaps best illustrated by the way 
an animal's body is supported by Its legs. Here several 
constraints simultaneously determine the relation of one 
body to another (the ground, in this case). A clearer 
example is that of a crane or antenna mast supported by guy 
wires. Because six constraints are needed to fix an 
object in three dimensions, that bounds the amount of 
parallelism possible at each "joint". 



* Sections 3.5, 3.6, and 3.7 were excerpted from A. I. MEMO 207, Marvin 
Minsky, MANIPULATOR DESIGN VlfiMETTES. 
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The sequential succession of constraints In the serial arm causes many 
problems that seen to grow In a multiplicative way: 

Errors and uncertainties arr* cascaded and cumulative. 

Rigidity Is relatively low because of long moment arms, 

Inertial and gravity effects are large, especially If the proximal 
joints have to support the mass of the distal motors. This and 
the low rigidity combine to produce large, annoying, low 
frequency vibrations. These make precise positioning slow (to 
avoid dangerous overshoots) and make delicate force-feedback 
measurements Impract ical m 

Power supply and "Innervation" require complicated "threading" 
through or around joints, especially If the motors are not 
bul 1 t in, but work through tendons. 

Some of these problems can be reduced hy making the proximal joints 
much larger than the distal ones, but this yields a massive 
and clumsy system, viz., a milling machine. 

All these problems can be controlled to various degrees, given enough 
attention to weight and dynamics, as in the vertebrate and insect arms, 
(lore dramatic Illustrations of serial cascading of joints are seen in 
vertebral columns, especially of the serpent. Strictly speaking, none of 
these ^re purely serial, each having two or more actuators for each 
joint. This is one way to reduce the amount of serialization. 

Another way to reduce the amount of cascading Is to divide the mobility 
of the whole system into two parts by moving the work as well as the 
manipulator. Example: In some ml 1 1 ing~machines that need three degrees 
of freedom, the bed on which the work is mounted has two horizontal 
axes; the third axis moves only the cutting-head. Another "solution" 
Is the novi ng" robot approach: by walking or driving about the floor, one 
gets two degrees of freedom without the cost of transmitting power and 
Information through two joints. The machine has to be attached to the 
floor anyway, one can argue, so why not exploit this? One can regard the 
floor as a ballpoint with zero curvature! 

In any case, the parallel approach promises to reduce conpl Icat ion. 
Ball joints, with three degrees of freedom, have no more parts than 
single hinge joints. What really is difficult Is to make a two-degree 
joint, with freedom to bend but stiff axially; this Is the "universal 
joint" problem. 
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Paral lei flan t pulators 



The parallel approach is complementary, with quit* different problems 
and features. To introduce It, begin by considering the general probl 
of positioning a rigid body In space relative to a frame of reference* 
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Suppose given three fixed reference points In space and 
three points on the rigid body. Then there are nine 
distance-pairs between these points, but specifying almost 
any six of these causes the other three to be determined. 
This observation suggests a very simple and direct approach 
to design. Choose six of these distances. Then construct a 
manipulator by realizing physically each length constraint 
as some mechanical length-determining device, such as a 
hydraulic cylinder or other "linear actuator". 

Each actuator must he terminated by a spherical joint or elastic 
coupling. Then we acheive complete mechanical control of the rigid 
object simply by Instructing separately the motors for all degrees of 
freedon, without cascading their effects. 

A particularly symmetrical example of such a design is shown below: we 
choose six edges of a cube to position one equilateral triangle with 
respect to another. The resulting structure outlines an octahedron? 



The six edges are the ones 
that form the hexagonal shadow 
when a cube is balanced on one 
of I ts vert ices! 





In pr Incipl e# It fol lows from the basic constra tnt-determinat Ion idea/ 
that one can position the body In any location and orientation In three- 
dimensional space. However, there are practical problems: 



In certain oos I t ions 
coincide) making the 
flop. 



the constraints degenerate (e.j;., two rods 
position indeterminate* The structure will 



As we approach a degenerate situation, the 
become too small, great forces are needed, 
buckle. 



mechani ca 1 advantages 
and the structure will 
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In practical Implenentat I ons, it Is hard to find large ranges In 
which the supports do not Interfere with one another by colliding. 
This is particularly severe In regard to axial rotations. 

The supports must subtend a substantial space angle to get much 
stiffness. On the other bund/ an arm should subtend a small space 
angle (looking from the hand) to achieve dexterity. In optical 
jargon, one wants a hand to have a large "f-number" ! 

The ability to get around obstacles is limited. With a serial arm 
one can use redundant degrees of freedom to get a tentacular 
effect. It Is an Illusion, however, that serial arms inherently 
provide dextrous access, since unless the elbows are redundant, the 
multijolnted arm doesn't allow for alternative paths. Of course/ 
with six degrees of freedom one has a three-dimensional selection 
of ways to reach a point in the workspace* and one can trade 
between global arm-path configuration and the precise direction of 
arrival at the work. 

The actuators must he length-changers, in contrast to those In the 
serial arm, which can be linear or angular. This is usually a 
large advantage, because in the parallel system, the natural way to 
effect constraints Is by pulling tendons. Cable-pulling mechanisms 
are easy to design and can be very compact. 

Although para I lei systems have dl sad vantages, these seem quite 
different from those of the serial system* There are Important 
advantages, as well , 

Very great simplicity, because of the non-interactions. 

The instrumentation of force-sensing is part Icularl y 
convenient; the long I tudlfial stresses in the supports 
determine completely the forces operating on the mobile plate 
(unfortunately, including gravity). As shown in 1.3 below* 
one can exploit this to get very elegant and useful kinds of 
force- and tactile- feedback. 

The forces are entirely axial, so that light, thin tubes can 
yield great strength. Serial arms In general, and angular 
actuators in particular, have bad weight -strength 
charactfirl sties. 
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3.6 FORCE SENSING 

1 wish I understood better the Issues concerning kinesthetic feedback. 
The advantages of "bi 1 ateral" servomotors over "open-loop" control are 
easily demonstrated/ but my own experience is that the quality of the 
"feeling" one sets In operating a bilateral master-slave manipulator is 
very low. If the gain is high, the system is unstable, while If the 
gain Is modest It feels mushy. Presumably the Inertlal forces, when 
reflected back to the human user, cannot be opposed quickly enough 
because of our 200 millisecond reaction time problems. 

How does the human armaid control system manage so well? He have at 
least three levels of not-too-t Ightly coupled systems with sense and 
motor devices of different characters: motor-force (as In the bilateral 
servo manipulators), local strain sensing at the joint areas, and 
tactile sensing at the exterior surfaces. This Information Is used, 
then, in a heterarchical control structure. 

How does this control structure work? I do not know the literature very 
well. I suspect that It Is not well understood, and the control-theory 
analyses I have seen (but not studied) do not seen to get to the point. 
Presumably, the heterflrchlcal system uses several different kinds of 
Information, about position, pressure, speed, etc.. In local systems 
*ach with Its own loons and parameters. The control structure couples 
them by sending around signals that adjust gains, time-constants, etc. 

The higher levels computer these by combining state Information with 
goal information. 

What's wrong with the simple "bilateral servo" system? (This is the 
system that measures the forces reflected through the motors that 
actuate the joints.) One trouble Is that the force on an exterior object 
Is the SUM of the driving force and the Inertlal force of the moving 
system, as It Is decelerated hy pushing on the obstacle. The "force- 
reflecting" servo can never see the latter force. Forces at the hand 
depend on momentum terms from all the way up the arm. "Theoretically", 
the control system can contain a dynamic model nf the arm, compute the 
Inertlal forces, and subtract them from the actual measurments, but this 
means measuring small differences between large numbers, and there is a 
lot of noise from friction, dynamical vibrations, and so on. The gravity 
forces have to be subtracted, too, notice that In the serial arm this 
is not an all-or-none argument. The signal-noise ratio just mentioned is 
poor for the "upper" or "proximal" (near the arm origin) joints and good 
for the distal 1 (near the hand) joints. For a non-redundant mechanism 
there is no sure way to guarantee that the sensitivity required for a 
delicate manipulation will be reflected to a suitably distal jolntl 
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Thi s argument shows a fundamental advantage, I th Ink/ for ha v inn a 
complete set of fOrCe"SftnSors in the wrist or very close to the work-* 
point. That is, for a system like that described under "Force 

Feedback 11 below for measuring forces near the workpoint without the 
noise of large Inertial components. With a wrist force-sensor, one 
knows Instantly when the hand has made contact, and how hard. If the 
arm Is moving rapidly, one cannot stop It instantly, but if the wrist 
can be relaxed while the upper arm decelerates, the contact can still he 
gentl e. 

What/ by the way. Is a relaxed wrist? In a non-redundant conf (curat ion 
one can have high compliance — low-lnertlal gentle contact ~ only 
along those dimensions whose actuators are close -- in the serial 
sequence — to the hand. This Is why one should give a high design 
priority to getting at least three degrees to combine In a recognizable 
wrist-like structure. Anthropomorph ism has a lot going for it. But It 
Is hard to put all mobility at the wrist/ and even the human hand Is 
vulnerable to thrust through the radial axis: as In catching a ball on 
the end of one's finger. 

In any case. If a redundant wrist is relaxed, and the force sensors 
signal a collision, there may still he time to react before the pressure 
gets large; with a non-redundant bilateral servO/ the poor signal-noise 
ratio requires us to wait until the force is larger. 

If we cannot afford full rootori zat Ion of the wrist/ It would still be 
valuable to have a spring-loaded, loekable, compliant joint there. 

The sane arguments/ in micro-form, apply to fingers as well, and dictate 
a third stage of sensing. This again might be a combination of joint" 
force elements and, of course, the ultimate dispersion of nerve-endings 
on the tact i le surfaces. 

Force feedback for posl t Ion-sens I ng. 

Speaking of tactile sensors, It Is an amazing mathematical fact that/ 
under certain conditions, one can use joint force-sensing (or even 
bilateral servos) to get the effect of tactile sensors over a surface. 
That ls# the measurements can tell where a surface has been touched! The 
"certain condl t ions" are simple and somewhat restri ct i ve; the surface 
must be touched at just one point. This 1s not so bad, because this 
usually happens at a "first contact". If the condition Is not met/ one 
still gets important information that can he useful when combined 
heterarchl cal 1 y with other knowledge. 
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3.7 THE FOURIER URIST PHIHCiPLfi 

A wrist needs mobility* strength, and a protnctod I n£ t rumen t at Ion 
channel for Its hand. To give the hand access to the work from different 
directions, a wrist should he slender — the arm should subtend a small 
space angle as seen frcn the hand. Because the wrist Is rear the hand, 
large angular errors mean rel<itlv*?!y small hum? lute errors, 50 absolute 
accuracy of angular control Is not very critical. For the systems we 
envision, wrist control would be adequate even with increments of 
several angular degrees. 

These requirements suggest the use of a rleformablc tuhular structure. 
In very small scale systems the requirements of strength And rigidity 
virtually dictate using "exnskeletal " or tubular structures: central 
rods are not stiff enough and pin-joints are too weak. The tuhular 
construction Is al so attractive for Inst rumen tat ion, because the 
information channels are insulated by the exoskeleton, anil the interior 
Is a nearly cons ton t-1 ength environment. 

Discrete (localized) joints cause serious problems both for exo- and 
endo- skeletal structures. The bending radius Is very small at a 
discrete joint/ and to avoid this one has to route tendons and other 
elements along complicated paths. 

An apparent solution to all these problems Is 
to use a continuously flexible tube. This 
section Is about some aspects of such a 
design. T"ie simplest such wrist, no doubt/ 

is a plastic tubo or rod deflected by AS^L. -^ f — ^f-' 

external tendons constrained to its exterior/ *^" £ff^- ^;*^^1 

as shown here. This has problems and 
advan:ages: 

STRENGTH: Tubing has the best strength-weight characteristics. 
However, flexible tubing has to be weaker, and tends to buckle and 
collapse under load. A compromise Is discussed below in 5.1. 

BENDING: Under a pure bending force, the curvature tends to be 
uniform. Under more complicated loads an elastic bean tends to be 
wobbl y, and bends non-unl fornl y. "Jp dl gcijss <tabl I J i nation 
5c hemes In 5.2 below. 

C0N5TRAI NT: Tendons tend to saan across concave arcs, and have to 

be constrained* The constraints mfly couac friction «nd wear 

problems , 
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"Vertebral" Segmented Columns 



the 



Many of these problems stem fron 
we must either make the tubing thin, 
elastic modulus — in short, make it 
use a strong material and got the 



fact that to make a beam flexible 
or use a material with small 
weak. One kind of solution Is to 
flexibility by slipping. 



Two ways to do this are shown here: The 
segmental method solves the problems of 
longitudinal strength, tubul ar col lapse, and 
suggests several methods for tendon 
constraint. The segmental approach makes the 
column stability problem worse- It offers 
the possibility of variable stiffness In 
exchange: one can use f r let ion to lock the 
system by pulling all the tendons* to get 
greater rigid! ty. 




.^CfciAai' 
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«y 



Also, one can make the friction very low, to get ^n extremely compliant 
wrist, by relaxing the tendons that act counter to the desired direction 
of motion. This principle is used in several commercial holding and 
post tioning devices. 

An Idea that has come up from time to time is to mechanize a vertebral 
column digitally, that Is, to make each joint have just two or four 
states. One might binary-code the angular deflections. This ought to be 
feasible, for a wrist, since one ought not need more than about 5 bits 
of control* The purely binary scheme does not seem too good, however, 
because one would not want any one joint to have to rotate through a 
large angle. 



3.8 FLEXIBILITY AND HARMONIC ANALYSIS 



If we want to distribute angular deflections over appreciable path 
lengths, we have a theoretical problem about controlling the excess 
degrees of freedom. (To count degrees of freedom for a continuous rod, 
one has to use a signal theory method. If one describes the 
configuration In terms of spatial frequencies, there Is a rapid 
attenuation of high frequencies.) In any case, we arfi interested in the 
case where there are more degrees than we are prepared to control 
expl Icl tl y. 
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The curvature in a beam tends to he constant, other things 
being equal/ because the strain energy Is a faster than 
linear function of local curvature* So thn energy of the 
bean has its minimum for a given total curvature when it is 
uniform! y distributed* Unfortunate! y, this quadratic 
minimum means that the resistance of the system to 
perturbations that transfer a small annunt of curvature 
between two different segments is very small. Thus the 
unlformlzing tendency Is poorly coupled to the cross spatial 
conf Igurat ion. 



Now observe an Interesting phenomenon that occurs in a flex 
with tendons constrained close to the surface of the tube. 



le wrist 



To a very good 
independent of 



approximat ion the net change 
the tube's conformation. 



The basic phenomenon stens from the fact that 
for snail angles the x = sin x approximation 
Is vary good. Consider a flexible rod with 
opposed deflection tendons, and shorten the 

upper one a distance D: (Actually* the tendon 
on the convex side will 
the same amount • I n the 
be the difference*) 



be pul led in by 
anal ysis below. 



about 
let D 



If the rod has 
the other, the 

Hence A ■ D/T / 
is independent 



thickness T and length L, and one s 
rod will bend In a curve for which 

ACR+T) - AR = AT = D 
where A is the bending angle in radians, 
of L- 




tlote 



Now, 

rod is 
Dl/T + 

length 
of how 
words, 
end wi 



we assumed uniform curvature In this argument, 
actually bent sharply in one part and gently 
02/T = D/T again, so that for a ^Iven total riiff 
one gets the same net angular deflection of the 



But suppose that th* 
In another. Then A ' 
erence in tendon 
t ip independent 



the curvature Is actually destrlbuted along the rod! In other 
the same D Is compatible with all configurations that begin and 
th the same directions, such as in 




■% 



j 



or 



h 



"/r.f 
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One might he ahle to make a nice paml lol-ruler device exploiting this 
principle. Handling such a beam Is an experience; It seems completely 
free for translation hut flrnly constrained for direction of the tip, 
which seems to have a mind of Its own* 



flow to enforce uniform curvature, we must distribute Increments of 
i In length) along our bean. Consider a first approxlmat 

two equal halves of L; then we want somehow 
add an extra tendon firmly attached 
tha ,-od at the middle, 

r ---t'„_j i t _ 

- i * Z ft L 



wh ich D ■ 
constrain 
both ends 



PI + D2, 
Dl = 02, 
but cross 



Solution! 

ng through 



D 

Ion in 
to 



Then one can write: 



trf- 



L3 
L2 



LI » 
+ Ik 
* U 



L3 



E 



L 

L 



( Ident I ty) 
(initial condition) 
(good approximation) 



a 



Hence LI ■ L2. Thus the extra constraint divides the curvature equally 
between the two halves. One could add still other constraint-cords, 
crossing over at other points: the problem is to equalize the 



deflections In each segment 
for more segments: 



examples 






Discussion of 
inextenslble. 




s for 



Example 1: 
this scheme 



C * - Example 2. 

To the extent that the oblique cords are 
ought to he quite effective in uniforming 
the deflection. It is like the well-known "lazy-tongs" device. It tends 
have latlve error, in that the curvature can slowly drift from 

many segments. As drawn* there Is 
parts of the rod near the cross-over 
*ng each constraint over three 
curves ex per lenced by the 



one end to the other 
also a problem about 
points; this should he 
segments, and this al so 
scabll Izlng tendons. 



if there ar^ 

unconstrained 

corrected by 

relieves the 



runn 

sharp 




^^^^^7!^^^^k^^ Example 1 



Note that each wire needs a symmetrically opposite one for negative 
curvature control t 
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Discussion of Example 2: Ue have shown several constraint cords with 
suggestive labelling. Each cord runs the full length of the rod, so 
that the effects are global (no accumulated error). Let PI and -01 be 
the length changes at the top and bottom of the I-th segnent* Then we 
have: 

sin A: 01 + 02 - 03 - D'i = 

cos A: 01 - 02 - D3 + Wi « 

sin 2A: 01 - 02 + 03 - 0U - 

The first two equations yield 01 - 03 = (1 

The last two equations yield 01 - 02 ■ 

The first and last yield Dl - 0b * fl 

So all four segments have equal change: the total change D Is 
controlled by the top straight fibre. 

Our choice of trigonometric labels was based on a strong analogy. We can 
use the constraint" cables for control as well! If we shorten the "sin 
X" cable by an amount 0* the equations still yield 01 « 02 and 03 = 0U, 
and (assuming the straight fibre Is unchanged) the rod assumes * sigmoid 
for Still with the original tip- direction: 

If we let C(x) be the curvature of the rod as a function of length, we 
now have 

C(x) = 0* sin {^p*> ^'IeW^^ 

Controlling the other fibres similarly, we can develop the curvature of 
the rod In a Fourier series: 

It would be Impractical to do this for more than eight segments, and 
four would be quite enough for most purposes. 
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Three Dimensions 



Extending this idea to control ling a space-curve promises to eliminate 
tun nuisances. First, by winding the tendons around the beam Instead of 
through It/ we Avoid penetrating the centra] core. (2) This sane scheme 
can eliminate the occurence of "deed" Intervals at which the tendons are 
near the ax is 
advantage) , 
Hinusoi dal . 



the occurence of "dead" Intervals at which the tendons ar 
and so provide little constraining force (poor mechanical 
Our scheme is to use Helical winding Instead of 



Using helical winding, one avoids the problem of tendons escaping from 
concave portions of the bean. It appears that a large number of fibres 
are requl reti. 

The four pairs of the 2-d case must each he duplicated in 
two planes* Our idea is to make two sets of windings, 90 
degrees out of phase, in both directions around the 
cylindrical rod. Each must be duplicated again. In the 
opposite direction, to oppose the effects of axial torque. 
That makes 16 pairs of fibres. Since we really do have 3 
degrees of freedom, the system certainly needs a tendon 
pairs. Possibly, half the windings could be eliminated if 
the tube has enough inherent axial stiffness, but this Is 
not easily compatible with longitudinal flexibility. One 
way to get the required kind of stiffness is to have hinge 
joints In alternating orientation, as in the lobster arm* 

These i ssues are not so serious. Even a two "segment" arm, in three 
dimensions, would already be a splendidly mobile device, and its helical 
geometry problem does not look \/^ry difficult. Going to four "segments" 
may raise more serious problems about friction and tendon-crossovers. 
Higher terms in the series gets us involved with long cables (the "high 
frequency" sinusoids wrap around the rod a lot) and would probably cause 
severe f fictional bind ing problems because the forces normal to the tube 
would become large. These forces don't look serious for the two and 
four segment designs . 



"ACK 35 



3.3 MIMI-ROBOT nLOCK-DIAMAM 



INTERFACE TO ARPA-NETWORK OR 
TO TIME-SHARING MACHINE DIRECT 




MIHI-RQBDT SYSTEM 
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ARTIFICIAL INTELLIGENCE LABORATORY 

Ml CRO-AUTOMATI OIJ DEVELOPMENT 

1 April 11173, through 31 March 197*1 

OUR Contract * NOOOHi-70^A-03G2-OO0r> 

ARPA Order # 200fa, Renewal 

Salaries and liases (see personnel/ section J*. 2): 

dollars (nan n>onths) 

Facul ty: 25,500 <U*5) 

lllnsky 25% effort 

Winston 50% effort 
Horn 755 effort 

Research Associates 5,500 (5) 

Research Staff 37,000 (3U) 

Administrative Staff 5,5(10 (5) 

Technical Support Staff 6,500 (S) 

Secretarial i\ Clerical 3,000 (12) 

TOTAL Suhject to E.fi. — 8&,000 

Employee Benefits Q 17.11 15,000 

Research Assistants 23,000 (30) 

TOTAL Suhject to OH. 111,000 

Overhead 25. 5^ 28,500 

TOTAL 15*4,500 

Space Rental (see space breakdown, section <i.3): 

Labs and Offices In 5U5 Tech. Sq. 111,500 

Lab and Office Modification and Renovation 1,000 

Publications A Postage 3,000 

Office Supplies 1,500 

Travel 5,000 

Telephones, Dntaphones ft Data Lines 500 

Materials ?j Services (see section U.4) 15,000 

Equipment (see section fc.5): 

typewriter A engineering calculator 1,000 

TOTAL BUDGET 5200,000 
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*j.2 PERSONNEL 

Professor Patrick Winston and Research Associate Dr. R. K. P. Horn will 
direct this p roc mm under Professor Marvin Mlnsky's continued 
supervision. Professor 'Jinstnn also directs the A, I , Lab's main vision 
research effort which is administered under QNR MO00H-70-A-0362-0O03, 
and supported on ARPA order lOSWi, Professor Winston's vision research 
programs will provide hi^h level vision processing to ARPANET users of 
completed Mini Robots. 

ftr, Horn Is expected to become a member of MIT's Electrical Engineering 
faculty in September 1973 and has been included in this budget as first 
a Research Associate at 100?;, then as an Assistant Professor at 75% 
Professor Winston is budgeted here for 505 during his nine month 
academic year and 755 for a two month sunrner. Professor Minsky is 
included at 255 for the academic year and 505 for the summer. 

The research staff consists of Mr. Lernan and Mr- Finin, programmers, 
and one electronics engineer to be hired. Administration includes 
purchasing, payroll and support staff management all under R. Moftsker, 
A.I, Lab manager, for a total of 5 man months. Eight Research 
Assistants now working on basic vision research are shared In this 
budget with the main Artificial intelligence research contract. 
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fc.3 MICRO-AUTOMATION SPACE 

the MICRO-AUTOMATION development program now occupies 150 sq. ft. of 
MIT, A.I. Lab eight floor office space* It Is planned to relocate these 
six offices to the third floor when computer space becomes available on 
3/1/73, This coincides wi th the arrival of the first MICRO-AUTOMATION 
computer equi pment. 

The MICRO-AUTOMATION program space plan during this proposal period is 
to lease 1,S00 sq. ft. of third floor, 5^5 Tech. Sq.* office and 1,000 
sq. ft. of ai rcondi tioned false floor space for development work. The 
annual space cost will be $18,500, or $18,500 during this contract 
period. Renovations, budgeted at $1,000, are for minor modifications to 
al rcondi tinning, power wiring and lighting which could he performed 
under the lease at a 50* premium by the same construction contractors 
which the A.I. Lab will use. 



k.k MATERIALS AND SERVICES 

The previous year's experience indicates that approximately *15,000 will 
be required for drafting, illustrating, minor computer and interface 
parts, replacement parts, computer and shop consumables, handling 
charges and other unforseen Items. 
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h. 5 f-nUIPMENT 

A scientific calculator has been budgeted for engineering work and a 
$500 typewriter i ten Is Included for a new secretary position in the new 
office/lab area. Other cap I to 1 equipment purchases were funded last 
contract year but deferred for temporary lack of space anrl personnel. 
The originally proposed PDP11 computer system has been ordered and 
HICRO-AUTOMATION electronic interfaces are now heing designed, specified 
and ordered. 

Victor Schelnman of Stanford University's Artificial Intelligence 
Project visited the HIT, A. I. Lab for 3 1/2 months during the fall of 
1972, and designed a snail manipulator {section 1.1) which will be 
constructed and paid for with first year funds. 



